An Information-Theoretic Perspective on Coarse-Graining, Including the Transition from Micro to Macro
نویسنده
چکیده
An information-theoretic perspective on coarse-graining is presented. It starts with an information characterization of configurations at the micro-level using a local information quantity that has a spatial average equal to a microscopic entropy. With a reversible micro dynamics, this entropy is conserved. In the micro-macro transition, it is shown how this local information quantity is transformed into a macroscopic entropy, as the local states are aggregated into macroscopic concentration variables. The information loss in this transition is identified, and the connection to the irreversibility of the macro dynamics and the second law of thermodynamics is discussed. This is then connected to a process of further coarse-graining towards higher characteristic length scales in the context of chemical reaction-diffusion dynamics capable of pattern formation. On these higher levels of coarse-graining, information flows across length scales and across space are defined. These flows obey a continuity equation for information, and they are connected to the thermodynamic constraints of the system, via an outflow of information from macroscopic to microscopic levels in the form of entropy production, as well as an inflow of information, from an external free energy source, if a spatial chemical pattern is to be maintained.
منابع مشابه
Entrograms and coarse graining of dynamics on complex networks
Using an information theoretic point of view, we investigate how a dynamics acting on a network can be coarse grained through the use of graph partitions. Specifically, we are interested in how aggregating the state space of a Markov process according to a partition impacts on the thus obtained lower-dimensional dynamics. We highlight that for a dynamics on a particular graph there may be multi...
متن کاملNeutral Emergence and Coarse Graining
We introduce the concept of neutral emergence (defined by analogy to an information theoretic view of neutral evolution), and discuss how it might be used in the engineering of robust emergent systems. We describe preliminary results from an application to coarse graining of cellular automata.
متن کاملInformation-theoretic tools for parametrized coarse-graining of non-equilibrium extended systems
In this paper, we focus on the development of new methods suitable for efficient and reliable coarse-graining of non-equilibrium molecular systems. In this context, we propose error estimation and controlled-fidelity model reduction methods based on Path-Space Information Theory, combined with statistical parametric estimation of rates for non-equilibrium stationary processes. The approach we p...
متن کاملPii: S0377-0257(00)00135-x
We give a compact non-technical presentation of two basic principles for reducing the description of nonequilibrium systems based on the quasi-equilibrium approximation. These two principles are: construction of invariant manifolds for the dissipative microscopic dynamics, and coarse-graining for the entropy-conserving microscopic dynamics. Two new results are presented: first, an application o...
متن کاملFluctuation-preserving coarse graining for biochemical systems.
Finite stochastic Markov models play a major role in modeling biological systems. Such models are a coarse-grained description of the underlying microscopic dynamics and can be considered mesoscopic. The level of coarse-graining is to a certain extent arbitrary since it depends on the resolution of accommodating measurements. Here we present a systematic way to simplify such stochastic descript...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Entropy
دوره 17 شماره
صفحات -
تاریخ انتشار 2015